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The  following  is  Intended  to  correct  some  errors  In 
the  above  Memorandum  and  to  add  a  few  comments  vdiich 
seem  appropriate.  We  start  with  errors. 

Page  6,  line  12  should  be: 


11m 

t-»r 


<  00  . 


Page  17*  line  8:  Change  1  —  y  to  1  —  Y. 
Page  52,  line  11:  Change  <  to  >. 

Page  5^,  line  7:  Change  88i  to  cos. 


As  to  the  supplements,  we  first  note  that  Theorem 
6.13  can  be  considerably  extended,  and  should  be 
changed  to  read  as  follows: 


Theorem  6.13.  If  e  is  aperiodic  and  positive, 

then 

(6.29)  llm  P(V  .  k)  =  (E\;  q  , 

n-KX)  “  J.  K 


and  thus 

P(V_  =  k) 

(6.30)  llm  - ^ - 

n-«)  P(V  =  J) 


More  generally,  we  have  that  a  necessar’y  and  sufficient 


condition  for  (6.30)  to  hold  Is  that  (6.21)  be  eatlafled. 
Proof .  We  have 


and  aa  P(\^4c  “ 


(6.31)  P(V^  -  k) 


f(Wl  >  l'  -  1)  -  ‘■(’n.k  >  >') 

m  have  that 

k  k— 1 

-  j^qW-j-i 


Now  If  8  Is  aperiodic  and  posltlvBf  (6.29)  follows 
from  (6.31)  upon  taking  limits  by  the  renewal  theorem. 

If  (6.21)  la  valid  then  (again  from  (6. 31))  we  have 

in.  V'  •  I')  ■  0^' 

which  establishes  (6.30)  for  the  case  of  J  ■  0.  llie 

general  case  then  follows  at  once  from  this  result. 

Conversely  If  (6.30)  Is  valid  then 

P(V_  -  1)  [  \ 

q  .  iim  ^  .  lUn  I  -gti  ^lo  +  'll  - 

^  n-KO  ?{\  -  0)  n  [  ^  1  'Oj 

and  thus 

llm  ^  -  1. 
n-<oo  'n 


As  Is  clear  from  Sec.  6,  a  great  many  results  depend 

on  whether  or  not  llm  ■  1.  In  general,  this 

limit  need  not  exist.  In  this  regard.  It  might  be  of 

Interest  to  point  out  that  llm  vi  always  exists. 

n  " 

More  specifically,  we  have  the  following: 
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Theorem.  If  e  Is  an  aperiodic  recurrent  event. 


then 


lira  u, 
n-«> 


1/n  _  1 


n 


where  R  Is  the  radius  of  convergence  of  the  series 
n«0  ^ 


Proof.  Let  e  be  aperiodic  and  let  lira  sup  u, 
Then  for  Infinitely  many  n  we  have  for  any  e, 

0  <  e  <  1/R^  that 


1/n 


n 


%  >  (5  -  ')"• 


Suppose  the  above  Is  satisfied  for  n 
any  k  =  0,1,2,...,  we  have 


m.  Then  for 


“to  >  K)''  2 

But  since  e  Is  aperiodic,  we  have  %  >  0  for  m  >  Nq. 
If  n  >  2ra  then  n  =  (k  +  l)m  +  r,  k  =  0,1,2,..., 

0  ^  r  <  m,  and  thus 

“n  i  %nVr  ^  <R  -  “m+r  >  >  °« 

Where  A  »  inf  >  0.  Hence  If  n  >  2m  >  2N„,  we 

Oj^rcn  -  0 

have 

and  thus  lira  Inf  >  1/K  —  e.  But  as  e  was 

n  —  ' 

arbitrary,  we  must  have  lira  Inf  >  1/R- 


Remark.  The  above  argument  Is  a  straight  adaptation 


to  the  setting  of  general  recurrent  events  of  an  argument 
due  to  Kakutanl  In  [2I  to  prove  the  result  for  the 
special  case  of  "return  to  zero,"  for  Integer-valued 
random  variables. 
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PREFACE 


Part  of  the  Project  RAND  program  consists  of  basic 
supporting  studies  in  mathematics.  The  mathematical  research 
presented  in  this  Memorandum  deals  with  the  theory  of 
recurrent  events,  a  subject  of  basic  interest  in  the  theory 
of  probability  and  its  military  and  scientific  applications. 


-V- 


SUMMARY 

The  asymptotic  behavior  for  large  n  of  various  quantities 
associated  with  a  recurrent  event  Is  Investigated.  The 
results  are  applied  to  give  Information  about  certain 
functionals  of  sums  of  Independent  random  variables. 
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SOME  LIMIT  THEOREMS  ASSOCIATED  WITH  A  RECURRENT  EVENT 


1.  INTRODUCTION 

In  this  Memorandum  we  study  the  asymptotic  behavior 
for  large  n  of  various  random  sequences  associated  with  a 
recurrent  event,  extending  results  found  in  [4],  [71,  [8], 
[9],  and  [12I.  The  results  found  for  general  recurrent 
events  are  then  applied  to  the  study  of  various  functionals 
of  sums  of  independent  random  variables,  with  the  explicit 
purpose  of  trying  to  encompass  results  on  the  fluctuation 
phenomena  of  sums  within  the  framework  of  the  general 
theory  of  recurrent  events.  However,  these  are  to  be 
looked  on  as  examples  only,  since  no  attempt  has  been 
made  to  try  to  exhaust  this  method.  Applications  to  other 
Markov  processes  are  not  considered,  but  no  doubt  could  be 
given. 

In  summary,  then.  Sec.  2  is  devoted  to  a  review  of 
the  definitions  and  notatlonal  conventions  which  are  used 
in  this  paper.  In  Sec.  3  criteria  for  transience, 
positivity,  etc.,  are  presented  in  terms  of  the  sequence 
[EY^},  where  is  the  time,  as  observed  from  n,  that  the 
event  last  occurs.  Section  4  is  devoted  to  finding 
explicitly  the  Joint  limiting  distribution  of  (N^,  Y^^), 
where  is  as  above  and  N^  is  the  number  of  occurrences 
of  the  recurrent  event  by  time  n.  In  Sec.  5  other  Joint 


t 
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Umlt  dlatrlbutlons  with  are  given,  and  conditional 

limit  distributions  of  N  are  found.  Local  limit  theorems 

n 

for  the  various  random  sequences  associated  with  recurrent 
events  are  given  In  Sec.  6.  In  Sec.  7  some  strong  laws 
connected  with  are  Investigated.  The  results  of  these 
sections  are  applied  to  sums  of  Independent  random 
variables  In  Sec.  8.  The  criteria  of  Sec.  3  are  applied  to 
give  useful  results  on  ladder  points,  which  contain 
results  Implicit  In  the  work  of  Spltzer  In  [l?].  The  Joint 
limit  distribution  of  the  maximal  partial  sum  and  Its  time 
of  occurrence,  and  the  conditional  limit  distribution  of 
the  maximum  given  Its  time  of  occurrence,  are  given  for 
the  special  case  of  summads  of  mean  zero  and  finite 
variance.  For  Integer  valued  the  recurrent  event 
"Sn  =  0>"  la  also  Investigated.  The  paper  concludes  with 
an  Appendix  containing  extensions  of  known  Abelian  and 
Tauberlan  theorems  that  are  frequently  useful  In 
probability  work  and  are  needed  In  the  proofs  of  some  of 
the  theorems  In  the  paper. 


2.  PRELIMINARIES 

Let  e  be  a  recurrent  event  on  the  nonnegative  Integers, 
with  waiting  times  these  being  Independent  and  Identi¬ 

cally  distributed,  positive.  Integer- valued,  random  variables 
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that  can  also  assume  the  value  •.  We  recall  that  e  is 
called 

(l)  transient  If  P(W^  <  •)  =  p  <  1, 

(ii)  certain  If  p  =  1, 

(ill)  null  If  p  =  1  and  EW^  =  ■, 

(iv)  positive  If  p  =  1  and  EW^  <  ■, 

(v)  periodic  of  period  r  If  e  can  only  occur 
at  times  nr  for  n  =  0,  1,  2,  ...  . 

Definitions . 

(2.1)  =  sup  (k:  +  ...  +  n)  (number  of 

occurrences  by  time  n), 

(2.2)  =  W^  +  Wg  +  . . .  +  (time  of  last  occurrence), 

(2.3)  “  '"^l  +1  ”  (time  till  next 

n 

occurrence  as  measured  from  n). 

For  |t|  <1,  denote 

(2.4)  P(t)  «  E[t  W,  <  •]  =  Z  P(W,  =  k)t*^, 

^  k=l  ^ 

(2.5)  U(t)  =  Z  P(Y  =  n)t"  (Yq-O), 

n-0  "  ^ 

•  m 

(2.6)  T(t)  -  Z  P(Y„  -  0)t"  =  Z  P(W,  >  n)t”. 

n»0  n«0 
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In  addition,  let 


u„  -  P(Y„  -  n),  -  P(Y^  .  0). 

Unless  otherwise  specified,  t  will  always  be  such  that 
|tl  <  1  and  X,  y  will  be  quaiitltles  such  that  |x|  <  1 
and  |y|  £  1.  If  X  is  a  random  variable  and  A  an  event 

we  shall  denote  J*  X  dP  by  E(X;  A). 

A 

3.  CRITERIA  FOR  RECURRENT  EVENTS 
Lemma  3«1- 

(3.1)  S  t"  E(y^"  x^"^)  «  T(t)[l  -  yP(xt)]"^  . 
n«0 

Proof.  P(N^  =  k,  =  r)  =  P(W^  +  ...  +  Wj^  =  ^  -  r), 

and  3.1  follows  upon  taking  generating  functions.  We  shall 
need  (3.I)  In  the  next  section.  All  we  need  here  Is  the 
special  case  with  y  =  1,  which  is 

•  r,  T 

(3.2)  Z  t"  E  X  =  T(t)[l  -  F(xt)]"^  . 
n=0 

Theorem  3.1.  Let  =  E(Yj^  -  Then 

U(t)  ■  exp  Z  t^/k  A.  . 
k*=l 


(3.3) 


Remark.  This  curious  exponential  Identity  shows 


that  knowledge  of  {E  Y^}  for  all  n  completely  determines 
the  recurrent  event  e.  It  came  to  our  attention  through 
Professor  M.  Dwass. 

Proof.  Differentiate  (3*2)  with  respect  to  x  at  1 
to  obtain 


(3.4)  (1  -  t)  2  t*^"^  E  -  U'(t)/U(t). 

n-0  " 

Thinking  of  the  left  hand  side  as  a  known  function  of  t, 
we  see  that  (3.4)  Is  a  dlffei’entlal  equation  for  the 
function  U(t).  Since  U(0)  «  1,  the  right-hand  side  of 
(3.3)  Is  the  unique  solution  to  this  equation.  We  are 
now  In  a  position  to  prove  the  following  result. 

Theorem  3.2.  Suppose  that  e  Is  a  recurrent  event 
and  that  -  E(Yj^  -  Yj^_^).  (Aq  -  O).  Then 

(3.5)  1  -  p  -  P(W  -  •)  =  e 

If  e  Is  aperiodic j  then 


In  the  sense  that  both  sides  are  finite  or  infinite 


and  always  equal. 

Proof.  Since  >  0,  (3.5)  follows  from  (3-3)  and  a 
generalized  version  of  Abel's  theorem.  Now  suppose  e  is 
aperiodic  and  that  2(1  -  converges.  Then 

EW,  =  llm  T(t) 

^  t-1" 


Zt^/\c  -  2  t^/k 
=  llm  e  e 

t-r 


=  llm 

t-1" 


e 


X  k— 1 

Since  e  is  continuous  in  x,  the  above  limit  is  e 

by  Abel's  theorem.  To  establish  the  converse,  we  must 

show  that 


“k  k 

lim  2  - -  t  -  EW,  <  • 

t-1  k=l  ^ 


^  \ 

Implies  that  2  — -  converges.  If  we  could  show  that 

llm  =  1,  then  the  desired  conclusion  would  follow  at 
k->« 

once  from  Tauber's  theorem.  To  see  that  llm  =  1, 

k-*« 


observe  that 
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(3.7)  (1  -  t)  Z  »  tP'(t)U(t)(l  -  t)  , 


and 


P‘(l)  »  EW^  <  •  , 

and  that  the  series  U(t)(l  -  t)  becomes  at  1  the  series 

Ui  +  (up  -  u,)  +  ...  =  lim  u  , 

n-« 

where  ^  well-known  renewal 

theorem  (see  [8])  we  have  11m  u  «  1/EW,,  and  so  the 

n-« 

series  In  (3*7)  converges  at  1  to  1  by  Merten’s  theorem. 
This  completes  the  proof. 

As  a  corollary  of  the  proof  we  have  the  following. 
Corollary  3.3.  If  EW^  <  •  and  e  Is  aperiodic,  then 

11m  L  =  lim  E(Y„  -  ,)  =1, 

-  (1  -  A  ) 

and  the  series  Z  - ■  converges  to  a  finite  positive 

value . 

Theorem  3.4.  Suppose  e  Is  a  null  recurrent  event. 

If  for  some  p  (O  <  P  <  l)  we  have 

1  ^ 

11m  n“  Z  Ai-  =  11m  Y  /n  =  p  , 
n-«  k=l  ^  n-«  “ 


(3.8) 
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then 


1  -  P(t)  -  (1-t)^  L[l/(l-t)]  , 


where 


(3.9) 


L[l/( 1-t)] 


iJl  (P  - 


Is  a  slowly  vai*ylng  function  of  l/(l-t).*  Conversely,  If 

1  -  P(t)  =  (1-t)^  h[l/(l-t)l 

for  some  p  (O  <  3  <  1)  and  slowly  varying  function  h, 
then  (3.8)  holds  and  we  must  then  have  h(x)  =  L(x),  where 
L(x)  la  given  In  (3*9)« 

Proof.  Lampertl  In  [lO]  showed  that  (3*8)  and 


1  -  P(t)  -  (1  -  t)P  hCl^) 


were  equivalent,  where  h(x)  Is  a  slowly  varying  function. 

To  Identify  h[l/(l-t)]  as  L[l/(l-t)],  observe  that  by  (3»3)>  we  have 

-  -  pto(l-t)  -  2  t^'A  K 

(1  -  tyHl  -  P(t)]  -  e  e 


3  t^A  -  2  t*^A  \ 


e 


which  establishes  the  result. 


A  function  L(x)  Is  called  slowly  varying  If  It  Is 
positive  for  x  sufficiently  large,  and  If  for  each  positive 
a,  we  have  L(ax)/L(x)  ■*  1  as  x-«. 


f 


Remark.  When  EW^^  <  •,  3  =  1  and  we  have  shovm 

that  11m  -  1.  It  la  an  open  question  as  to  when  this 

k— 

Is  true  for  0  <  0  <  1.  (See,  however,  theorem  8.3.)  in 
line  with  this  remark  It  might  be  well  to  point  out  that 
there  not  only  exist  recurrent  events  for  which 

lim  A,,  =  p,  but  there  Is  even  a  recurrent  event  for  which 

k— 

Aj^  =  p.  To  see  this,  observe  that  If  0  <  p  <  1,  then  If 
Ak  =  P  we  have  by  {3. 10)  that 

P(t)  =  1  -  (1  -  t)^  . 

Thus  fj^  =»  (-)^  (^),  which  is  positive  and  <  1,  and 

F(l)  =  fj^  =  1,  showing  that  these  (Aj^)  do  Indeed 
determine  a  recurrent  event. 

4.  THE  JOINT  DISTRIBUTION  OF  (N^,  Y^). 

This  first  theorem  is  only  to  establish  the  case  of 
greatest  Interest. 

Theorem  4.1.  If  e  Is  transient,  then  (N^,  Y^)  con¬ 
verges  with  probability  one  to  a  finite  random  vector 
(N,  Y),  ^ 

E(x'^  yN)  =.  (1  -  p)[l  -  yF(x)]-^ 


(^.1) 
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If  e  Is  recurrent,  then  (N^,  Y^)  converge  to  •  wl th 
probability  one,  and  If  e  Is  positive,  then 

(4.2)  (N^n,  y^n)  — >  (l/EW^  1) 

with  probability  one. 

Proof.  Since  a  transient  event  takes  place  finitely 
often  with  probability  one,  (4.1)  follows  from  (3-3);  (4.2) 

Is  well  known  (see  e.g.,  [6]). 

Thus,  the  case  of  greatest  Interest  will  be  the  null- 
recurrent  case.  The  limit  marginal  distributions  for  this 
case  were  first  found  by  Feller  In  [9]  for  and 
Independently  by  Lamperti  In  [12]  and  Dynkln  in  [8]  for  Y^. 

Theorem  4.2.  Suppose  e  Is  a  null-recurrent  event. 

Then  In  order  that  there  exist  constants  a_  >  0.  b_  >  0 

■  n  —  '  n  — 

such  that  ^n'^^n^  should  converge  In  distribution 

to  (N,  Y)  having  a  nondegenerate  distribution.  It  Is 
necessary  and  sufficient  that 

(4.3)  1  -  P(t)  -  (1  -  t)P  L 

for  some  p,  0  <  p  <  1,  and  some  slowly  varying  function  L(x). 
If  condition  (4.3)  Is  satisfied,  then  we  may  choose 

a  =  n,  b  =■ 
n  ’  n 


(4.4) 


nP/L(n) 


11- 


and  the  distribution  of  (N,  Y)  will  be  uniquely  determined 
by  Its  moments; 


(4.5,  k(n"  Y^)  . 

(Remark:  An  explicit  formula  for  the  (N,  Y)  distribution 
will  be  given  below  In  Corollary  4.3)* 

Proofs  Necessity:  This  follows  at  once  from  known 
facts.  If  ^  nondegenerate  limit 

distribution,  then  clearly  N^/b^  must  have  one.  But  It 
was  shown  In  [4]  that  this  Is  true  If  and  only  If 
condition  (4.3)  holds  for  some  p,  0  <  p  ^  1. 

Sufficiency:  By  (3-3)  we  have 

(4.6)  Z  E[x^"  y^^"]  =  T(t)[l  -  yF(xt)]"^  , 

n=0 


which  Is  an  analytic  function  In  (x,  y,  t)  for  jxj  <1, 

IyI  .1  1^1  <  1.  Taking  the  m-th  derivative  of  (4.6)  with 

respect  to  y  at  1  results  in 

(4.7)  z  t"  E(x^^  N^®^)  =  m!P(tx)®[l  -  P(t)](l  -  t)"^ 
n=0  " 

.  [1  -  P(xt)]“^"^^^  , 
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where 

=  Nn  (N^  -  1)  ...  (N„  -  mfl)  . 

Set  X  ■  e  in  (4.7)  and  expand  in  powers  of  X  to 

obtain 

(4.8)  2(-)^A*'  (1-t)*'  2  t^  E(yJJ 

k  n=0 

*  [1  -  P(t)](l-t)"^F(te"^^^"^^)"'[l  - 

As  t-1", 


1  _  e“  ^(1-t)  ^  (1  +  x)(l  -  t)  , 

and  so,  taking  account  of  the  slowly  varying  nature  of  L, 
we  obtain  from  (4.8)  and  (4.3)  (after  a  slight  rearrange¬ 
ment) 

(4.9)  llm  2  X^(l  -  t)^'^^(l  -  t)^  iTttT  2  t"  E(Y^  N^"*^) 

t-1  ^1-t^  '  n  n  ^ 

=  (-)*"  klmJ  (1  +  \)-P("«-l)  . 
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Slnce  the  quantity  In  (4.8)  is  analytic  In  t  for 
It]  <  1  and  X  >  0,  and  the  right-hand  side  of  (4.9)  Is 
analytic  In  X  at  X  =  0,  we  obtain  from  (4.9) 


(4.10) 


llm  d-tjl'+e"  l(^)"  Z  t"  E(yJ;  n(">  -  n(”)) 


.  (-)''  k!  k!  ■ 

Now,  E(yJ!^  Is,  for  each  fixed  k  and  m,  a  monotone  Increasing 

function  of  n.  Hence  we  may  apply  Karamata's  Tauberlan 
theorem  (see  [5],  p.  507)  to  (4.10)  and  conclude  that 


(4.11)  E(nJ^‘"^  -  n^  n^  L(n) 


-m 


k.*  ml 

rtm^+IcfTy 


c 


p(nH-l)^  . 


Finally,  as  E(N^"*^  yJJ)  -  E(nJ;  yJJ),  n  -  we  have  (4.5). 

To  complete  the  proof,  we  must  show  that  these  moments 
uniquely  determine  a  distribution.  By  theorem  1.12  of  [15] 
this  will  be  true  provided  that  the  series 


(4.12)  2  E(N^  +  Y^")  =  •  . 

n=0 


A  simple  computation  shows  that 


T 


-u- 

E(N^  +  ~  1/2,  rib¬ 

and  so  (4.12)  certainly  holds.  This  completes  the  proof. 
If  we  set  k  =  0  in  (4.5) >  we  obtain  the  known  result 

that 

(4.13)  EN^  =  l/T‘(piiH-l)  . 


These  are  known  to  be  the  moments  of  a  distribution  on 
the  positive  ajcis  with  density 

(4.14)  g  (x)  =  (ttP)'^  Z  (-)’^'Vj-'  r(pj+l)  sin  TPJ  . 

(See  [4]).  If  we  set  m  =  0  in  (4.5)>  we  obtain  the  known 
result  that 


(4.15)  EY^  =  (-)"  C'B  , 


which  are  seen  to  be  the  moments  of  a  distribution  on  the 
Interval  [O,  l]  with  a  density 


fp(x)  =  sin  ttP/tt  x^"^  (1-x)"^  . 


(4.16) 
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f 


It  Is  possible  to  give  an  Interesting  characterization 
of  the  distribution  of  (N,  Y)  and  even  to  write  down  Its 
density  function. 

Corollary  4.2.*  (N,  Y)  Is  distributed  like  (N  Y^,  Y), 

vfhere  (N,  Y)  are  Independent,  and  Y  has  density  given  In 
(4.l6),  whl le  N  Is  a  positive  random  variable  wl.th  a 
distribution  uniquely  determined  by  Its  moments: 

Eif”  =  . 

These  are  the  moments  of  a  distribution  on  the  positive 
axis  with  density 

(4.18)  hp(x)  =  r{^l)  X  gp(x), 

where  gp((x)  Is  given  In  (4.14). 

Proof.  A  simple  calculation  shows  that 

(♦•19)  fe#  >)  -  Wi* 


and 


We  are  Indebted  to  Prof.  M.  Dwass  for  bringing  this 
corollary  to  our  attention. 
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The  result  now  follows  from  (4.20),  (4.19),  and  (4.17). 

Using  this  corollary,  we  have  (N,  Y)  has  a  density  on 
(0,  •)  X  [o,  l]  which  is 

(4.21)  Kp(x,  y)  =  hp(xy"^)  y"^  fp(y)  = 

r(p)  sin  ttPA^  Z  (-)  J-l/jJ  sin  Trpjr(3J+l)x“‘5y"PJ‘^( l-y)“^ 
J=1 


The  case  of  p  =  1/2  is  of  special  interest.  For  this 
case  we  have 


(4.22) 


(i) 

UDf 

0 

(ill)  Ky2(x,  y) 


=  ^-1/2  e-  ='V'' 

=  1  -  a- 

=  x/2t  e- 


Corollary  4.3.  Let  since  last 

occurrence  of  e).  Then  condition  (4.3)  is  both  necessary 

and  sufficient  for  (N_A_,  7_/n)  to  converge  in  distribution 
— '  •  n'  n  n  —  ■  ■  * - 

to  (N,  Y)  having  a  nondegenerate  distribution.  Moreover 


we  have 
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(4.23) 


E(N^  Y^)  = 


ml  ki 

r(k+l+p(nH-l)) 


which  are  the  momenta  of  a  distribution  on  [O,  •)  x  [o,  l] 
with  density 

(4.24)  y)  =  Kp(x,  1-y) 

where  Kp(x,  y)  Is  given  In  Eg.  (4.21). 

Proof.  We  have 

(4.25)  llj;  (Vn)"!  r  ll;  E[(nybj”  (l  -  Y/n)^] 


=  e(n"  (1-y)^}  =  Ei?"  E  (i-y)^  . 
A  simple  computation  now  completes  the  proof. 


5.  OTHER  GLOBAL  LIMIT  DISTRIBUTIONS 

Prom  the  joint  distribution  of  (N,  Y)  we  may  obtain 

the  joint  limit  distribution  of  (N  /b  ,  V  /n)  and 

'  n'  n  n'  ' 


(N, 


-  N_ 


n 


n'  n 


Since  the  proofs  of  these  follow 
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closely  those  used  by  Lamperti  in  [12]  for  V^^/n  and  Dynkln 
N  f  1  “  N 

in  [8]  for  ^  ,  respectively,  no  proofs  will  be 

°n 

Inc luded . 

Theorem  5-l»  Condition  (4.3)  is  both  necessary  and 
sufficient  for  (N^An*  to  have  a  nondegenerate  limit 

distribution.  The  density  of  the  limit  distribution  is 

(5.1)  hp  (x(l+u))(l+u)P  fp(l/l+u)(l+u)"2  , 

where  h^  and  f^  are  given  in  (4.8)  and  (4.16,  respectively. 
Theorem  5.2.  Under  condition  (4.3)> 


X  r 

=  J  J  ' 

0  0 


where  K„  is  Riven  in  (4.21)  and  G„{x)  is  the  stable  law 

-  P  - “■• -  -  P  - 

of  index  p  with  Laplace  transform 

J  e"  dGp(x)  =  e“  ^  . 

0 


Prom  corollary  4.2,  it  follows  at  once  that 
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P(N  <  X  1  Y  =  y)  =  P(N  <  xy~®)  , 

and  so  P(N  <  x  |  Y  =  y)  is  a  continuous  function  of  (x,  y), 
0<x<«>  0<y£l.  This  makes  It  plausible  that  for  b^ 

Given  In  (4.4),  we  have 

(5.3)  11m  P(Nj^An  1-^  1  Y^  =  [sn])  =  P(N  <  x  s"^) 
n-**» 

v.'hen  condition  (4.3)  holds.  Let  us  first  observe  that 
If  (5' 3)  Is  to  hold  for  all  s,  0  <  s  <  1,  then  condition 

(4.3)  Is  necessary.  However,  we  have  been  unable  to  show 
that  (4. 3)  Is  sufficient,  and  can  only  establish  (5.3) 
under  a  more  stringent  condition. 

Theorem  5.3.  Suppose  e  Is  a  null -recurrent  event 
such  that 


(5.4)  P(Y^  =  n)  ~  n^"Vr(p)  L(n)"^,  n--  , 

where  L(n)  Is  a  slowly  varying  function.*  Then  (5.3)  ho  Ids 
for  each  s,  0  <  s  £  l,and  In  fact  uniformly  for  0  <  e  _<  s  <  1. 

Proof.  P(Kyb„  i  X  I  =  Un])  -  P(N[3„jAn  i  x  -  [snl) 

and  so 

llm  P(N^An  <  1  Y^  =  [sn])  =  11m  PCN^br  ^  3  <  x  j  =  n)  . 

ri”**  ^  ^ 

- V - 

By  Theorem  3.4,  L(x)  must  then  be  given  by  Eq.  (3.9). 
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Now,  by  known  properties  of  slowly  varying  functions  (See 
[ll]),  we  have  ^[n/s]b“^-*  s”^  for  o  <  s  <  1,  and  uniformly 
so  for  0  <  €  <  s  <  1.  Thus  all  assertions  of  Theorem  5.3 
will  be  established  if  we  show  that  under  (5.4), 

(5.5)  llm  P(N^An  1  X  1  =  n)  =  P(N  <  x)  . 

n-** 


In  [7],  Dwass  has  shown  this  to  be  the  case  If  L(n)  Is  a 
constant.  To  establish  (5*5)  for  a  general  L(n)  we 
need  the  following: 

Lemma  5.4.  If  is  the  (iiH-l)-at  convolution  of  the 
seqxiences  (P(Yjj  =  n}  with  Itself,  and  If  condition  (5.4) 
ho  Ids ,  then 


“n~  r(p)r(S(m.l))  • 

Proof.  The  proof  Is  a  direct  consequence  of 
Corollary  (A. 5)  in  the  appendix. 

To  complete  the  proof  of  (5*5)>  we  observe  that 

Z  t"  E(x  =  n)  =  [1  -  xP(t)]"^  , 


and  thus 
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2  =  n]  =  ml  [l  - 


from  which  It  follows  that 


ECN^'"^  =  n)  =  ml  C^, 


where  is  given  in  the  lemma  above.  Hence, 


E(k(”)|Y„  -  n)  ~  [nVl,(n)l 


m 


which  by  (4.17)  are  the  moments  of  N. 

Remark.  At  this  point  we  shall  pause  to  point  out 
the  connection  between  condition  (5.4)  and  condition  (4.3)* 

If  (5.4)  holds  for  0  <  p  <  1,  then  a  well  known  Abelian 
theorem  (see  [5I,  p.  460)  assures  us  that 

(5.6)  1  -  p(t)  ~  (1-t)^  L(i/i-t),  t-*r 

and  thus  condition  (5.4)  holds.  On  the  other  hand,  if 
(4.3)  holds,  then  in  general  one  may  conclude  (via  Karamata's 
Tauberian  theorem)  only  that 


(5.7) 


n-^  . 


n 

Z 

k=0 


=  k)  ~ 


nP  L-^ 
TTT+p 


On  the  other  hand  If  we  know  that  P(Yj^  =  1^)  is  a  monotone 
function  In  k,  then  we  may  conclude  (see  Theorem  A. 3  in 
the  Appendix)  that 


(5.8)  P(Y„  ■  n)  ~  ■ 

For  future  reference  let  us  record  at  this  point  the 
following  equivalence  relation :( 5. 6)  and 

(5.9)  H\  -  0)  --  "'r(ilgj 

are  equivalent.  To  see  this,  observe  that  if  (5-6)  holds, 
then 


T(t)  ~  (l-t)P"^  L{-^) 
and  thus  by  Karamata ' s  theorem 

p(Yi  =  0)  +  ...  +  p(Y^  =  0)  ~  • 

But,  since  P(Y^  =  O)  is  monotone,  we  have  by  Corollary  A. 3 
that  (5*9)  holds.  Conversely,  if  (5.9)  holds,  then  the 
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Abellan  theorem  mentioned  above  shows  that 

T(t)  ~ 

and  thus  (5.6)  holds. 

Theorem  5«5«  Suppose  condition  (5.4)  ho Ids .  Then 
for  0<a<l,  0<3<a,  and  b^  »»  n^/L(n),  we  have 

(5.10)  llm  P(N„An  1  X  I  -  [sn])  0  <  x). 


where  _  Is  distributed  like 

— —  (Xj  3  —  ■  .  —  ■ I  —  I  ■  ■■  I , 


3^  Nj  +  (1-a)^  . 


Here  and  denote  two  random  variables  Independent  of 
each  other  and  distributed  like  N  and  N  respectively. 
Proof.  For  X  >  0  we  have 

(5.11)  <e'  '  I  .  („3,) 

-  ‘  I  ’'[nsj  -  [nslH'”  ' 


By  the  remark  following  Theorem  5.4  we  have  that  condition 
(4.3)  holds.  Hence  we  may  apply  Theorems  5.3  and  4.2  to 
£q.  (5«11)  to  conclude  that 
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-  X  N  /b„  -  X  8^  N 

llmE[e  "  1  »  [ns]^ 


which  establishes  the  assertion  made  In  (5. 10). 

6.  LOCAL  LIMIT  THEOREMS 

In  this  section  we  shall  Investigate  various  "local 
limit  theorems"  for  the  functionals  associated  with  a 
recurrent  event.  We  start  our  investigation  with 
where  we  have  the  following  general  result. 

Theorem  6.1.  For  any  recurrent  event 

n+m 

2  P(N  =  k) 

llm  ^ -  pVp^’ 

2  P(N^  =  J) 
r=0  ^ 


where  m  is  fixed  and  p  is  given  in  Eq.  3.5. 

Proof.  It  is  clearly  sufficient  to  establish  (6.1) 
for  the  special  case  of  J  =0.  Prom  the  relation 

P(N„  -  k)  =  2  P(W,  +  ...  +  W  =  n-j)  q,  , 

n  j^Q  X  K  j 


we  obtain 


n 

2 

r=0 


P(Nj. 


k) 


n 

2  P(W,  +  ...  +  W.  <  n-j)  q. 
J-0  J.  K  j 


X{l-a)^j^ 
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But  for  each  fixed  r  we  have 


%+r 


P(W^  + 


+  \  < 


0  as  n-^  , 


and  thus  by  an  elementary  theorem  on  Norlund  summablllty 
(see  [3],  p.  20)  we  have 


11m 

n-*« 


n+m 

2 

r=0 


P{N^  =  k) 


n 

2 

r=0 


P(Np 


0) 


lim 

n-*« 


n+m 

2  P(W,  +  ...  +  W.  <  n-j)  q. 

>0  i 

n 

2  q, 

j=0  J 


=  11m  P(W,  +  . . .  +  <  n)  =  , 

n-**  ” 

which  establishes  (6.1)  for  the  case  of  j  =  0. 

Under  certain  general  conditions  it  is  possible  to 
greatly  improve  upon  Theorem  6.1.  Thus  we  have  the 
following: 

Theorem  6.2.  If  e  Is  transient^  then 
lim  P(N^  =  k)  -  p''(l-p) 


and  thus 

‘  Vi 

(6.2)  11m  — jj  =  P  /P  • 


r 


If  e  Is  null  and 


(6.3)  1  -  F(t)  ~  (l-t)P  , 


where  0  <  p  <  1  and  L{x)  Is  a  slowly  varying  function,* 
then 

(6.4)  11m  r(l-3)n^L(n)"^  P(N  =  k)  =  1, 

n-^  “ 

and  thus  (6.2)  holds  in  this  case  as  well. 

Proof.  If  e  is  transient^  then  it  follows  from  Theorem 
4.1  that  Nyj  converges  to  a  finite  random  variable  with  a 
geometric  distribution  of  parameter  p.  Now  suppose  (6.3) 
is  satisfied.  If  we  set  x  =  1  in  Eq.  (3.1)>  we  obtain 

Z  t^  E  =  [l-P(t)](l-t)’^[l-yF(t)]"^ 
n=0 

~  (i-t)P”^  (1-y)’^  • 


Thus  by  Karamata's  Theorem  we  have 


n 

Z 

r»0 


But, 


for  0  <  y  <  1  we  have  that  E  y  is  monotone  in  n, 
''l(x)  must  then  be  given  by  Eq.(3.9j. 


and 
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thus  we  may  apply  Corollary  A. 3  in  the  Appendix  to  conclude 
that 

(6.5)  llm  r(l-p)n^  L(n)"^  E  y^*^  -  (1-y)"^  • 
n-« 

Let 


L(n)‘^  P(N^  =  k)  . 

Now,  it  follows  from  (6.5)  that  a_  ^  Is  bounded  for  each 
value  of  k,  and  thus  we  may  extract  a  subsequence  (by 
the  diagonal  procedure)  a_  ^  which  converges  to,  say, 
as  r-«.  But  then  It  follows  (again  from  (6.5))  that 
aj^  =  1.  If  then  there  were  another  convergent  subsequence 
of  a  the  same  argument  as  used  above  would  show  Its 
limit  to  be  1.  Thus  we  have 

llm  a  =  1, 

n— 

which  Is  the  same  as  the  assertion  made  In  (6.4). 

When  condition  (6.3)  holds  (or  more  generally  when 
(6.2)  holds  In  the  recurrent  case)  we  have  the  following 
curious  result. 

Corollary  6.3«  If  e  Is  certain  and  (6.2)  holds,  then 
for  0  <  J  <  k  we  have 
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(6.6)  llm  P(N^  =  J  I  <  k)  =  (k+l)‘^  . 


Proof.  If  e  is  recurrent,  then  p  =  1,  and  if  (6.2) 
holds,  we  have 


k 

llm  2  P(N  =  r)/P(N  =  j)  =  k+1. 
n—  r=0 


Prom  this  (6.6)  is  evident. 

Remark.  It  Is  easy  to  exhibit  aperiodic  positive 
events  for  which  (6.2)  falls  to  hold,  and  It  can  be  shown 
that  (6.2)  may  also  fail  for  null  events.* 

Turning  our  attention  next  to  Y^,  we  have  the 
following  result. 

Theorem  6.4.  For  any  recurrent  event. 


n+m 

2  P(Y^  =  k) 

(6.7)  1^^^2 -  .uj^/uj  . 

"  2  P(Y  =  J) 

r=0  ^ 


Proof.  (6.7)  Is  a  simple  consequence  of  the 
following  two  facts: 

(6.8)  P(Y„  -  k)  = 

- » - 

The  null  event  given  In  the  Note  proceeding  Theorem  6.5 
provides  an  example. 
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and 


(6.9) 


lira  t 
n-« 


n+m  \  z'  ^ 
r«o  r*0 


r) 


=  1. 


Again,  as  in  the  case  of  N^,  we  may  improve  upon 
this  result  in  many  Instances.  Thus,  if  e  is  transient, 
we  have  P(Y^  =  k)  -  Uj^(l-p)  as  n-^  and  thus 


(6.10) 


lim 

n-^ 


■“(Vn.  - 

-Tc^pnr 


V^j  • 


More  generally,  it  is  easily  seen  from  (6.8)  that  in  order 
that  (6.10)  hold,  it  is  both  necessary  and  sufficient  that 


(6.11) 


lira 

n-*« 


1  . 


In  the  transient  case  this  is  always  true  eind  in  the 
certain  case  we  have  the  following  simple  sufficient 
conditions. 

Theorem  6.5.  If  e  is  certain,  then  (6.11)  holds  if 
either  of  the  following  two  conditions  is  satisfied; 

(l)  ~  n’®  L(n)  for  a  >  0  and  some  slowly 

varying  function  L(x). 

(li)  e  is  null  and  u^  is  monotone. 
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Note.  If  0  <  a  <  1,  then  by  the  remark  following 

Theorem  5.5  we  have  that  (i)  and  condition  (4.3)  are 

equivalent,  and  in  this  case  L(n)  Is  given  by  (3*9) • 

It  Is  easy  to  see  that  (6.11)  may  fall  In  the 

positive  aperiodic  case.  Indeed,  It  may  not  even  be 

possible  to  write  the  ratio  in  (6.11)  (e.g..  If  is 

bounded).  In  the  null  case  the  following  example  shows 

that  (6.11)  may  also  fall.  Take  P(Wj^  ■  k)  =  0  \inlesa 

k  -  2'^  and  P(Wj^  »  2*^)  «  (1/2)*^.  Then  q^  -  (1/2)^  if 

2^  <  n  <  2^^.  We  then  have  Q^/^^n-l  ~  ^ 

thus  11m  sup  Q^/Qn-i  —  other  hand 

If  n  «»  2^  for  r  =  0,  1,  2,  ...,  and  thus  11m  Inf  <ln/Si-l  — 

Proof.  If  (1)  holds,  it  Is  easy  to  see  that  (6.11) 

Is  truej  so  we  need  only  establish  (6.11)  when  (11)  holds. 

If  e  Is  null,  then  >  0  for  all  n.  For  If  not,  then  for 

some  n  we  have  q  =0  and  thus  q^  =  0  for  all  n  >  n  which 

o  n^  n  —  o 

would  give  P(Wj^  <  n^)  «  1.  Consequently  EW^  <  •,  a  con¬ 
tradiction.  Prom  the  monotonelty  of  q^  we  have 


(6.12)  qn+iAnil. 
From  the  relation 


1 


n 

£ 

k-0 


%-k  ‘^k 


f 


I 
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It  easily  follows  that 


n 


n-1 

A  ‘>k<Vl-lc  -  Vie*  ^ 


By  the  renewal  theorem  (see  [3]*  P*  26)  we  have  -•  0, 
and  thus 


(6.13)  11m  Inf 

Combining  (6.12)  and  (6.13)>  we  obtain  (6.11). 

Corollary  6.6.  If  (6.11)  holds,  then  for  0  <  J  <  k 
we  have 

(6.14)  llm  P(Y^  -  J  I  1  k)  -  Uj(u^  +  ...  +  Uj^)"^  . 


Proof.  Obvious. 

If  e  Is  null  and  satisfies  condition  (5.4),  then  we 

have  the  following  local  version  of  the  generalized  arc 

sin  laws  for  Y„. 

n 


Theorem  6.7»  Assume  condition  (5.4)  holds.  Then 


(6.15)  P(Y^  -  k)k^‘P  (n-k)P  =  +  o(l) 


where  o(l)  converges  to  zero  uniformly  In  n.  k  as 
min  (k,  n-k)  -  •»  . 

Proof.  By  the  remark  following  Theorem  5.5  we  have 
that  if  (5.4)  holds,  then 


Thus,  from  (6.14)  we  have 


(6.16)  P(Y^  =  k)  ~  k^-^  (n-k)’P  L(k)"^  L(n-k) 

as  min  (k,  n-k)  -•  •.  But,  since  L(k)"^  L(n-k)  -  1 
uniformly  as  min  (k,  n-k)  -  •  and 

1  sin  IT  B 

r(B)r(i-B) - w  ' 


we  see  that  (6.I5)  follows  from  (6.16). 
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Corollary  6.8»  ^  k  ~  [sn]  for  0  <  s  £  1,  then 


(6.17)  lira  nP(Y  =  k)  -  ^  (1-s)”^ 


and  the  convergence  Is  uniform  In  s  for  0  £  €  _<  s  <  1. 
Proof.  A  direct  consequence  of  Theorem  6.7 . 
Turning  our  attention  to  =  n  -  Y^,  we  have  the 
following  result. 

Theorem  6.9.  For  any  recurrent  event  e 


n+m 

Z  ?{\  =  k) 

(6.18)  1=2 -  . 

"■*  Z  P(7_  -  J) 
r=0  ^ 


Proof.  This  result  follows  from  the  relation 


(6.19)  P(7„  -  X)  =  '‘n.k 'Jk 


by  an  argument  very  similar  to  that  used  to  prove  the 
corresponding  result  for  Y^.  The  details  will  therefore 
be  omitted. 

Going  to  the  strong  version  of  (6.l8),  we  have  the 
following. 


Theorem  6.10.  In  order  that 
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(6.20) 


P(7 


11m 
n—  P(7, 


n+m 


n 


-  k) 

J) 


9 


It  la  necessary  and  sufficient  that 

(6.21)  llm  -  1  . 


In  order  that  (6.21)  hold  It  Is  sufficient  that  one  of  the 
following  conditions  hold; 

(l)  e  be  aperiodic  and  positive. 

(ll)  be  eventually  monotone  and  e  be  null. 

(ill)  condl tlon  (5*^)  be  satisfied. 

Proof.  (6.20)  holds  If  and  only  If 


?(?„  =  k) 

(6.22)  llm - 2 - 

n—  P(Y  =  0) 


q 


k’ 


However,  It  la  apparent  from  (6.19)  that  (6.22)  holds  If 
and  only  If  (6.21)  does.  That  (6.21)  holds  under  condition 
(l)  Is  a  direct  consequence  of  the  renewal  theorem  (see  [3]> 
Sec.  6),  while  the  validity  of  (6.21)  under  (ill)  Is  obvious. 
It  remains  then  only  to  demonstrate  that  (il)  Implies 
(6.21).  To  show  that  this  is  true,  observe  first  that  by 
assumption,  there  Is  an  n^  such  that  n  >  n^  implies  u^^ 
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Is  nonincreasing.  If  e  Is  null,  then  >0  for  n  >  n^, 

for  if  »  0  for  m  >  n^,  then  -  0  for  all  n  >  m, 
in  o'  n  — 

and  thus  2  u„  <  •,  which  is  a  contradiction.  Thus  if 
n 

n  >  n  ,  we  have  u  . ,  <  u„  and  thus 
—  o  n+l  —  n 

(6.23)  “n+l/On  <  1- 

On  the  other  hand,  if  n  >  n^  we  have 

n  n 

u  -  2  P(Wj^  -  n-k)uj^  >2  P(W  >  n-lc)uj^ 

k»0 

>  u^  P(W^  <  n+l  -  n^) 


and  thus 

(6.24)  lim  inf  ^  1* 

Equation  (6.21)  now  follows  from  (6.23)  and  (6.24). 
Corollary  6.11.  If  condition  (5.4)  holds,  then 

(6.25)  lim  P(Y  -  k)  (n-k)^"^  k^  »  -  P  +  o(l), 

n-«  ^ 

where  o(l)  converges  to  zero  uniformly  in  n,k  as 
mln(k,  n-k)  -•  •. 
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Proof.  The  result  follows  directly  from  Theorem  6.7 
and  the  definition  of 

We  shall  conclude  this  section  with  the  Investigation 
of  V^.  As  with  the  preceding  quantities,  we  first  have  the 
following  general  result. 

Theorem  6.12.  For  any  recurrent  event  we  have 

n+m 

2  P{V^  =  k) 

(6.26)  11m  - • 

2  P(V„  =  j) 
r=0  ^ 

Proof.  It  suffices  to  establish  (6.26)  for  the  case 
of  J  =  0.  From  the  relation 

P(V„  >  k,  >  j)  .  >  k+j), 

for  k  >  0  we  obtain 


n-1 

P(V^  =  k)  =  2  u^  P(W^  =  n+k-r). 

r^O 


Using  the  fact  that 


u„,_  (u,  +  ...  +  u_)"^  -  0 
n+r  '1  n' 


as  n-^, 


we  obtain  for  k  >  0 
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n+m 

Z  P(Vp  -  k) 

(6.27)  llm  - 

2  P(V  -  0) 
r-0  ^ 


llm 

n-M» 


n+m 

2  u_(P(W,  <  n+nH-k+l-r)-P(W,  <  k)} 
r-0  ^ 


+  ...  +  u„ 
o  n 


-  llm  {P(W,  <  n+mfl+k-r)  -  P(W,  <  k) }  «  . 

n--»  ” 


On  the  other  heind.  If  k  =  0,  then 


n+m 

2  P(Vp  -  0) 

(6.28)  llm  ^ -  -  1  =  q^  . 

2  P(V  -  0) 
r»0  ^ 


Equations  (6.28)  and  (6.27)  together  establish  the  special 
case  of  (6.26)  for  J  «  0. 

For  the  strong  version  of  Theorem  6.12  we  have  the 
following. 

Theorem  6.13.  If  e  Is  aperiodic  and  positive,  then 


(6.29)  llm  P(V^  -  k)  -  1/EW^  qj^ 

n— 


and  thus 


llm 

n-*» 


P(V 


n+m 


n 


k) 

TT 


(6.30) 


-38- 


On  the  other  hand, If  condition  (5.4)  holds,  then 

(6.31)  P(V^  -  k)  ~  nP"V(3)  L"^(n), 


and  thus  (6.30)  Is  valid  In  this  case  as  well. 

Proof.  We  have 

p(v„  .  k)  .  >  k-l)  -  >  k) 


and 


P(Y, 


n+k 


r) 


%+k-r 


Thus, 


(6.32) 


P(V^  -  k) 


k  k-l 

%+k-J  ^3  '  jfo  %+k-l-J  ^3  • 


Now,  If  e  Is  aperiodic  and  positive,  then  the  renewal  theorem 
assures  us  that 


u^  -  as  n-**  , 


and  thus  (6.29)  follows  from  (6.32)  upon  taking  limits.  On 
the  other  hand,  if  condition  (5.4)  is  satisfied,  then 


u  ~ 
n 


L"^(n) 


and  (6.31)  now  follows  from  (6.32). 
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7.  A  STRONG  LIMIT  THEOREM 

If  e  Is  a  positive-recurrent  event,  then  N^/EN^  ■*  1 
with  probability  one  as  n-*“.  On  the  other  hand,  if  e  is 
null  recurrent,  then  Sec.  3  shows  that  under  very  wide 
conditions  has  a  nondegenerate  limit  distribution 

and  so  will  not  converge  to  1  in  probability.  The 

theorem  presented  below  shows  that  in  a  certain  sense  Nj^ 
does  behave  like  EN^.  For  the  special  recurrent  event, 
"return  to  zero,"  in  a  one-dimensional  random  walk,  it 
becomes  Theorem  6  in  [2].  The  proof  in  the  general 
case  is  almost  the  same  as  in  the  particular  case  in  [2], 
and  is  presented  only  for  completeness. 

Theorem  7»1»  Let  “  1  if  the  null-recurrent  event 

e  takes  place  at  time  n,  and  let  =  0  if  not.  Take 

r„  =  EN„  and  u„  =  EU_.  Then 
n  n  — —  n  n  —  ■- 

(7.1)  lim  (tn  r^)"^  2  Uj/Tj^  =  1 

n-.»  k=l 


with  probability  one. 

Remark.  The  above  result  perhaps  gains  in  interest 
by  comparison  with 


(tn  E  -  1,  with  probability  one. 


(7.2) 
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(7.3)  {in  r^)-^  2  -  1  , 

Ic*  1 


both  of  which  are  a  direct  consequence  of  the  Abel-Dlnl 
theorem. 

Proof.  As  (7.3)  shows. 


n 


(7.4)  E  Z  Uj^/Fj^  =  tn  F^  +  oim  Tj, 


k=l 


n 


n' 


n 


(7.5)  E(^2^  V^lc)' 


^  +  2  2  u  /F  2  u  /F 

k=l  ^  J=1  J  J  k=J+l  J  ^ 


Hence, 


n 


n  u,.  ,-u, 


n  ..  n  u.  (l-u.  )  .»  11  u.. 

(7.6)  var  {  2  U./F.}  =  2  JL—JL.+  2  2  u/F,  2  ^ 

^k=l  k=l  Fj^*^  J=1  J  J  k=J+l  ^k 


Now,  If  n-J  <  j+1,  then 


n 

2 

k=J+l 


u 


-  U. 


-  ^/^J+1  ^n-J  -  ^J+l/^J+1  “ 


while  If  n-J  >  J+1 , 


I 


Now,  Chebyshev's  Inequality  says  that  for  any  c  >  0, 
(7.7)  P  (|2  -  tn  r^l  >  e  tn  F^)  =  0(tn  F^)"^  . 


Since  e  is  null  recurrent,  F  /e  ^  -•  0  as  n-*«,  and  so  we 

n'  ’ 

may  choose  a  subsequence  n^^  such  that 


Thus, 

"k 

(7.8)  (tn  F  )"^  2  U/F  -  1  as  k—  , 

"k  J=1  J  J 

by  the  Borel-Cantelli  Lemma. 

To  finish  up  the  proof,  we  next  observe  that  if 


■Ht ; "  i  "k+i' 


then 
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(7.9)  r  )‘^  z  v./T 

"k+1  k=l 


,  n  ,  “^k+l 

-  W  kfi 


But  r  /r  ~  C“r”y  ~  1  k-^  ,  and  so  (7.1)  follows 

"k+1  "^k  ^  ^  ^ 

from  (7.8)  and  (7-9). 

If  e  has  waiting  times  which  satisfy  condition  (4.3) i 
then  the  theorem  can  be  improved  thus: 


Corollary  7.1.  Suppose  condition  (4.3)  is  satisfied. 

Then 


—  1 

(7.10)  (b  tn  n)“  Z  —s — ^ —  -  1  vJith  probability  one. 

k=l  nVL(n) 

Proof.  Condition  (4.3)  is  equivalent  to  EN^  ~  n^/L(n). 
Now  tn  L(n)  =  o(tn  n),  n-^.  To  see  this,  we  note  that 
any  slowly  varying  function  can  be  written  in  the  font 

n 

L(n)  =  a(n)  exp  j  e(t)/t  dt, 

1 


where  a(n)  -  c  >  0  and  e(n)  -  0  as  n-^.  (See  Karamata  [ll]). 
From  this,  the  above  corollary  is  immediate.  Thus 


f 
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tri  E  ~  ptn  n  as  n--»,  and  (7*  10)  follows. 

There  are  several  restatements  of  (5.1)  which  are 
interesting,  and  we  gather  these  together  in  the  following 
corollary. 

• 

Corollary  7.2.  Let  EN^  =  g(n)«  Then 

—  1  ^  -p  T 

(7.11)  (tn  g(n))  Z  g{W,  +  ...  +  W.  )  -  1  with  probability  one, 

k=l  ^ 

(7.12)  In  g(W,  +  ...  +  W^)  Z  g(W,  +  ...  +  W^)  1 

^  ^  k-1  ^ 

with  probability  one,  and  if  condition  (4.3)  is  satisfied, 
then 


Nn 

(7.13)  (P  In  n)"^  Z  (W^  +  ...  +  W^)"^  L(W,  + 

k=l  ^ 


with  probability  one, 

1  ^  ft 

(7.14)  p  tn  (W^  +  .. .  +  W^)  Z  (W^  +  ...  +  Wj^)"P  L(W^+.  ..+Wj^)  -  1 

Proof.  (7.11)  follows  from  (7.1)  by  definition  of  U^. 

(7.12)  follows  from  (7.11)  by  choosing  n  «  +  ...  +  . 

(7.13)  and  (7*14)  follow  similarly  from  (7.10). 
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8.  APPLICATIONS  TO  SUMS 

Let  Sq  “  0,  and  *=  +  ...  +  be  the  n-th 

partial  sum  of  a  sequence  {X^}  of  Independent  and  identically 
distributed  random  variables. 

Definition.  A  nonnegative  integer  n  is  called  a 
positive  (or  a  strictly  positive)  ladder  point  if 

3„  i  Sj,  0  <  1  <  n.  {or  >  S^,  0  <  1  <  n), 

respectively.  A  similar  definition  holds  for  negative 

and  strictly  negative  ladder  points.  The  fundamental 

fact  about  ladder  points  is  that  they  are  recurrent  events. 

Fx^jm  now  on  we  shall  denote  the  strictly  positive  ladder 

points  by  e'  and  the  negative  ladder  points  by  e".  The 

quantities  defined  in  Sec.  2,  when  referred  to  these 

events,  will  be  denoted  by  a  prime  (e.g.,  N^l^)  and  a 

double  prime  (e.g.,  ,  respectively.  Thus,  for 

exeimple,  denotes  the  number  of  strictly  positive 

ladder  points  by  time  n,  and  (W^)  the  waiting  times  of 

negative  ladder  points,  etc. 

In  terms  of  the  (W*),  we  define  a  sequence  Z  as 

IV  n 

follows.  If  W'  <  •,  then  define  Z,  =  S„,,  while  if  W'  »  •, 
i.  X  w  ± 

leave  Z^  undefined.  Suppose  that  Z^,  Zg  ...  Z^  have  been 

defined.  Then  define  Z^^^  “  S^,  ^  ^  -  (Z^  +  ...  +  Z^) 

if  <  •,  and  leave  undefined  if  =  •  .  Then 
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i 

I 

I 

i 

(see  [l4l)  the  (Zj^,  W^}  are  independent  and  identically 
distributed  bivectors.  If  »  max(0,  S^,  Sg  •••>3^^) 
and  Ljj  Is  the  time  at  which  first  occurs,  then 

(8.1)  .  Zj  +  Zj  +  ...  +  Z^,  , 

(8.2)  Iv,  -  • 

A  fundamental  theorem  due  to  E.  S.  Anderson  [l]  is  the 
following. 

Theorem  8.1.  (Equivalence  Principle)  If  and 
are  respectively  the  number  of  positive  and  nonpositive 
sums  amongst  S,,  S«  ...,S  ,  then  Y*  =  L  and  Q  have  the 

il  11  11  11 

same  distribution,  aind  Y"  and  QJ  have  the  same  distribution. 
~  ■  '  *  n  -  ■  '■  n - - —  ■  ■' —  '  ■■  ■'  - 

A  simple  proof  of  Theorem  8.1  can  be  found  in  [l4]. 

From  this  theorem  it  follows  at  once  that 

(8.3)  EI^  =  EQj^  =  P(Sj^  >  0), 

(8.4)  EY”  -  EQ^  =  Z  P(Sj^<0), 

Ic®  1 

and  thus  the  results  of  Sec.  3  yield  at  once  the  following 
theorem. 

Theorem  8.2.  e '  is  transient  if  and  only  if  e”  is 
positive  recurrent  and 


e '  Is  positive  recurrent  If  and  only  If  e '  Is  transient  and 


(8.6) 


EW'  =  (1-e")"^  =  exp 


2  P(Si,  <  0)/k 

k=l  ^ 


(In  (8.5)  the 


exp{-  2  P(S^  >  0)/k 
k=l  ^ 


is  taken  to  be  zero  if  the  series  diverges.  In  (8.6)  both 
sides  are  finite  or  infinite  together,  and  finite  if  and 
only  if 


2  P(S^  <  0)/k  <  •  . ) 
k=l  “ 


If 


n 

(8.7)  11m  1/n  2  P(Si^  >  0)/k  =  p,  0  <  p  <  1  , 

n-«  k=l  - 


then 
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w  • 

(8.8)  (1  -  E  t  ^)  -  (l-t)P  exp  S  t*'(p  -  P(S^  >  0))A  • 

k-1 

Furthermore,  since  P{Y^  ■  n)  -  -  n)  » 

P(Sj^  >  0,  Sg  >  0,  ^  ^  monotone  function  of  n, 

then  conditions  (4.3)  and  (5.4)  are  equivalent,  and 

(8.9)  P(L^  =  n)  =  P(Yj;^  -  n)  ~  nP"V(p)  L'(n)‘^  , 
where 

•  ,  k 

(-8.10)  L«(n)  -  exp  Z  (1  -  ■^)  tp  -  P(S,,  >  O)]  . 

k=l  “ 

Remark.  If,  in  particular  the  sums  are  attracted 
to  a  stable  law  with  log  characteristic  function 

(8.11)  -  C  |Xl®  (1  +  i  p  sgn  \  tD(\,a)), 

>  0  and 

a  /  1, 
a  -  1, 

fact  that  11m  P(S^  >  0)  ■  p 


where  0  <  a  <  2,  -l£P£l»  0 

if 

if 

then  (8.7)  holds  by  virtue  of  the 
Moreover,  in  this  case  we  have 


tan  ^ 

u»(X,a)  =( 

I  ^ 

pr  in  1\1 
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(8.12)  P  -  I  +  ?!  J  ®"  Cp?  u)(a,?))* 

0 


which  for  a  /  1  can  be  explicitly  evaluated*  as 


(8.13)  P  “  ?  (-  p  tan  ^  a)* 


To  establish  (8.12)  let  f(x)  be  the  density  of  the  stable 
law  In  question.  Then  formally  we  have 


-  1  +  2p  «  J  sgn  X  f(x)dx  ■  ^  J  f(x)dx  J  -  d5 

-•  -•  0 


- 1 J  ■■ -V  1 

0  -• 


-  I  J  ^ -  sln(-  Cp?*  I«(?,a))d? 

0 


“  ii  J  ®’ 

0 


which  for  a  /  1  Is 


We  are  Indebted  to  0.  Gross  for  showing  that  the  formal 
evaluation  of  p  could  be  performed  by  the  formal  calculation 
given  here. 
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8in{-  CP5  tan  ^  arctan  (-  p  tan  ^). 


(See  table  of  Laplace  tramsforms  on  page  125  of  [13])*  To 
make  this  formal  derivation  rigorous,  we  must  justify  the 
Interchange  In  the  order  of  Integration  used  above.  This 
follows  from  the  standard  theorems  (see  e.g.  Hobson's 
Treatise  of  Real  Variables,  p.  349;  Vol.  2-of  the  Dover 
Edition)  by  observing  that 

a  P 

(a)  J  J  °>ilJ  f(x)  d5  dx  <  •  for  all  finite  a,  a,  p. 

0  a 

(b)  Each  of  the  required  Iterated  Integrals  exist. 


(c) 

f  sis^  a 

f  r"  rH 

iJ  +J  , 

1  f(x)dx 

<  M 

.  a 

J 

0 

-•  0  as  a  -•  1 

i--  b  i 

b  . 

i  -•  b  / 

(^)  I  J  J  ^  <15  I  <  CA  -  0,  b  -  •  , 

-•  b 

where  C  Is  a  positive  constant. 

O 

For  the  special  case  when  EX^^  ■  0,  var  »  0  <  •  (a  =«  2), 

Spitzer  In  [I6]  has  shown  the  following  Important  result. 

Theorem  8.3.  If  EX^^  ■  0,  var  X^  ■  <  •,  then  the  series 
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f 

i 

( 

I 

{ 

I 

f 


£  lA  (1/2  -  P(Sj,  >  0)) 
k-1 

converges,  and  if  y  Is  Its  sum,  then 

(8.14)  11m  L'{n)  -  e^  . 

n-*« 


Furthermore.  In  this  case  EZj^  <  •»  and 

(8.15)  EZ^  •=  o//2  e^  . 

Prom  (8.14)  we  have  that  (8.9)  improves  to 

(8.16)  P(Iyj  -  n)  «  P(Q^  «  n)  ~  e"  ^  (nv)"  n-*«  , 

as  was  found  by  Spltzer  in  [16].  Use  of  the  above  facts 
enables  us  to  translate  all  of  the  results  of  Seca  3-5 
Into  results  on  the  functionals  associated  with  e'.  As 
examples  we  have  the  following. 

Theorem  8.4.  Suppose  =  0,  var  =  0  <  •  and 

0  <  s  <  1.  Then 

(8.17)  11m  P(M^/a>ni  <  X,  Ljj/n  <  y) 

n*-* 

-  l/ir  J  J  X  e”  y‘^(l-y)“^/^  dx  dy, 

0  0 
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where  x>0,  ^£7^1^ 


(8.18)  lira  P(MyoVn<  xll^  «  [sn]) 
n-^ 


(l-e“^^/2®,  {x>0). 


0, 


X  <  0  . 


Proof.  The  3ti*ong  law  of  large  numbers  asserts  that 


Z-i  +  . . .  +  z 

1  n  ^  T.ry 

n  ^^1 


with  probability  one.  Thus, 


„  Z^  +  . . .  +  Z 

^  n  r>rr 

IT  •  r -  - 

n  n 


with  probability  one.  In  addition,  we  have 


b^  ■  n^/^/L'(n)  ~  n^/^  e”  ®,  as  n-*«  , 


and  consequently 


EZ^  bj^  -  o(n/2)^/2 


Thus,  by  Corollary  4.2, 
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lim  P(M^/oVn  <  X,  L^n  <  y) 
n-^ 


“  iiS  ^  1  yj  -  ^1/2  *'  ' 

where  K^yg  (^»  y)  given  in  formula  (4.22).  This  proves 

(8.17)j  and  (8.l8)  follows  similarly  from  Theorem  5.3. 

Remark.  In  the  above  proofs  the  only  essential  use 

2 

which  was  made  of  the  assumptions  EX  *■  0,  var  X  k  a  <  • 
was  to  gjuarantee  that  <  •.  More  generally  we  have  that 


EZ  "b  -  ^  I  ‘Vi  ■ 

n--*  1  n 


“  J  hp(x)  dx  * 
0 


whenever  X^^  has  a  distribution  for  which  EZ^^  <  •  and  (8.7) 
holds.  In  particular,  this  will  be  the  case  if  EX  <  0  or 
if  (8.7)  holds,  EX  »  0,  and  X^  is  bounded  above. 

By  using  Theorem  6.7  and  (8.9)  we  have  the  following 
local  form  of  the  generalized  arc-sin  laws  for  Q^. 

Theorem  8.5» 


sin  TT  B 


+  0(1), 


k^'P(n-k)’P  P(Qj^  -  k) 


IT 
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where  o(l)  converges  to  zero  tinlformly  In  k,  n,  m 
min(k,  n-k)  -  «  . 

For  the  case  when  the  {X^}  are  aperiodic*  Integer- valued 
random  variables,  a  recurrent  event  which  has  been  much 
studied  Is  the  event  •  0*  The  results  of  the  preceedlng 
sections  may  be  translated  to  give  Information  about  the 
functionals  associated  with  this  event,  by  use  of  the 
following  lemma. 

Lemma  8.6.  If  for  some  slowly  varying  function  h(n) 
and  some  a,  0  <  a  <  2,  S^/h(n)n^/®  converges  In  distribution 
to  the  stable  law  with  log  characteristic  function  given  In 
(8.11),  then 


(8.19)  lira  h(n)n^/®  g(o)  P(S  «  O)  •  1, 
n— • 

where  g(0)  ^  la  the  value  of  the  density  function  at  0  of 
the  law  given  In  (8.11). 

Moreover,  If  a  1  then 


(8.20)  g(0)-^ 


r(l/a)[(C  +  1  p  tan  ^)^/®  +  (C  -  1  p  tan  2^)^/®] 
2va  (C^  +  tan^  I|)Va 


while  If  a  ■  1  we  have 


(8.21)  g(0)  ^  ^  J  ®  co8(^  C  p  1  tn  X)dX  . 

0 


1  e  X 

E  e 


1  If  and  only  If  0  ■  2mr  for  Integer  n. 


9 


For  the  symmetric  case  (when  p  «  O)  we  have 


(8.22)  g(o)"^  -  0<a<2. 

ira  C  ' 

Proof.  Equation  (8.19)  is  an  Immediate  consequence  of 
the  local  limit  theorem  for  lattice  distributions  (see  Sec. 
50  of  [10]).  To  evaluate  g(0)”^  observe  that  if  a  /  1,  then 

g(0)-^  =  ^  J  e"  P  X  tan  dX 

-  J  e“  881  (C  X®  p  tan  p)dX 
0 

=  J  e  ^^cos(CXp  tan  -^)  ,X^/®  ^  dX. 

0 


From  the  tables  of  Laplace  transforms  in  [13]  on  p.  125,  this 
last  Integral  may  be  evaluated.  This  results  In  the  right- 
hand  side  of  (8.20).  A  similar  calculation  gives  (8.21). 

Remark.  From  (8,19)  it  follows  at  once  that  if  the 
satisfy  Lemma  8.6,  then  the  event,  «  0,"  is  transient 
If  a  <  1  and  null  recurrent  If  a  >  1.  We  may  then  apply 
the  results  of  the  previous  sections  to  obtain  information 
about  this  particular  recurrent  event.  As  a  novel  application 
we  have  the  following. 
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Theorem  8.7»  Let  B^{x)  for  1  <  1  <  r  ^  r  functions 
on  the  Integers  such  that  for  each  1, 

(8.23)  S  1Bj^(x)1  <  •  and  Z  Bj^(x)  =  /  0. 

Then  If  (8.19)  Is  satisfied  for  1  <  a  <  2, 


(8.24) 


lira  P(  S  h.  (Sj/B.  1  X  ,  1  1  1  £  r;  Y  /n  < 
n—  ^k=0  1  ^  1  n  1  n- 


.^r) 


y)  dx  dy. 


(8.25)  llm  p(  2  B,JSj,)/^^Yn  5  1  <  i  <  ^  1  =  [ns]) 

n-*«  k=0  ^ 

«s  ^  mln(x, , . . . ,x  ) 


where 


*  n^"^/®/h(n)  g(0)"^  (l-l/a)"^ 


and  K^_^^^(x,  y)  Is  given  In  (4.21),  hj__^y^(x)  Is  given 
In  (4.18)  and  Y^^  Is  the  time  of  the  last  return  to  zero. 
Proof.  As  the  proof  of  (8.24)  and  (8.25)  are  almost 
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Identlcal,  we  shall  only  prove  (8.24).  By  Corollary  2, 
Sec.  15  of  [3I,  If  Is  the  number  of  returns  to  zero 
during  the  first  n  steps,  then  for  each  1,  1  <  1  ^  r. 


(8.26)  llm  Z  B.(S.  )/N  «  B. 

n—  k=l  ^  ^ 


with  probability  one.  Equation  (8.19)  implies  that 
ENn  ~  Y„  «  n^“Va/h(n)  g(0)‘^  (l-l/a)"^. 


and  30  by  Theorem  4.2, 


X  y 

(8.27)  llm  P(NyY„  1  X,  Yj^/n  <  y)  =  J  J  y)  dx  dy. 

0  0 

Combining  (8.26)  and  (8..27),  we  obtain  (8.24). 

To  conclude  this  section  let  us  note  that  whenever 
the  satisfy  the  conditions  of  Lemma  8.6  for  1  <  a  _<  2 
we  have  that  condition  (6.3)  is  satisfied.  Thus  we  may 
apply  Corollary  6.3  to  obtain  the  following  result. 

If  is  the  number  of  zeros  amongst  the  first  n  sums 
which  satisfy  the  conditions  of  Lemma  8.6,  then 

llm  P(N^  «  J  I  <  k)  »  (k+l)“^  . 
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APPENDIX 

We  present  here  the  extensions  of  the  Tauberlan  and 
Abelian  theorems  which  Include  Lemmas  5.4  and  5.5  as 
special  cases.  The  special  case  of  theorem  A.l  for 
L(x)  =  constant  Is  due  to  Landau,  and  may  be  found  on 
p.  517  of  [5]  as  Helfsatz  3.  The  Abelian  Theorem  A. 4 
can  be  found  for  the  special  case  of  L(x)  =  constant  as 
Theorem  41  on  p.  98  of  Hardy's  famous  treatise  on 
divergent  series. 

Theorem  A.l.  Suppose 

(A.l)  P(t)  =  J  (J>(u)  du, 

0 

(A. 2)  Is  monotone  for  u  sufficiently  large, 

(A. 3)  F(t)  ~  At^  L(t),  t— , 

where  y  >  0  and  L{x)  Is  a  slowly  varying  function  (l.e., 
L(x)  >  0  and  L(ax)  ~  L(x),  x— , for  every  positive  a).  Then 

(A. 4) 


cp(t)  ~  vAt^"^  LCt),  t 
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proof.  We  shall  assume  that  cp(u)  Is  positive  and 
monotone  increasing  if  t  is  sufficiently  large.  Only 
obvious  modifications  are  needed  to  take  care  of  the 
other  possibilities.  Thus  if  t  >  T^,  cp(t)  is  positive 
and  monotone.  If  O  <  a  <  1  and  t  >  T^^/a, 

t 

cp(at)t(l-a)  _<  I  fp(u)du  <  f!i(t)t{  1-a) , 
at 


and  so 


M»T)  <  <  »(t). 


L(t)  <  ■-  < 

t^  L(t)(l-a) 


Thus 


(A. 5)  Tim  -  <  iim  rr)(t)/t^"^  L(t)  . 

t--i  t^"-^  L(t)  “ 


Now 
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11m  — 
t 


cp(at) 


■ns 

t-^ 


_ q)(at) 

(at)^”  L(at) 


L(t) 


Thu  3 


a 


Y-1 


Tim  — 

t— 


y(t) 

^  L(t) 


Taking  the  limit  as  a-1,  we  obtain 


?L^.) _ 

tY-i  L(t) 


<  Ay  <  lira 


which  completes  the  proof. 

Corollary  A. 2.  If  (A.l),  (A. 2),  (A. 3)  hold  except  that 
Y  =  0,  then  we  may  conclude  that 


cp(t)  =  o(L(t)/t),  t— 


Proof.  If  Y  =  0,  then  (5)  becomes 


(A. 6)  11m 


<  0  <  11m  —  j 

tY-^  L(t)  -  "  tY-1  L(t) 


cp(ttt) 


and  the  remainder  of  the  proof  is  the  same. 


Corollary  A.  3.  If  the  sequence  a^,  aj^  >  0,  is 
monotone,  and 

+  ...  +  a^  ~  n^  L{n) ,  n-^, 

then 

(A. 7)  a^  ~  Y  L(n). 


Proof.  Choose  cp(t)  =  a^  if  n-l<  t  <  n.  Then 


cp(t)dt  =  a^^  +  ...  +  a^^  =  P(n), 


and  (a. 7)  follows  from  Theorem  A.l. 

Theorem  A. 4.  ^  r  >  -1>  s  >  -1  and  a(x),  b(x) 

Integrable  on  any  finite  positive  Interval,  and  if 

a(x)  ~  x^  L(x),  b(x)  ~  X®  h(x), 

for  L(x),  h(x)  slowly  varying  functions,  then 
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(A.8)  C(x)  =  a(t)  b(x-t)dt 
0 

^  X-. 

Proof.  Suppose  0  <  6  <  1/2,  6^^  <  (iM-l)€,  6®'*'^  <  (s+l)€ 

and 

(A.9) 

1  1-6 
=  J  u^(l-u)®  du  <  J  u^(l-u)®  du  +  e  . 

0  6 

Wrl  te 

6x  (l-*)x  X 

C(x)  =  J  +  J  +  J  =  C^{x)  +  CgCx)  +  C^^x)  . 

0  6x  l-6)x 

By  the  assumptions,  there  Is  some  x^(€)  such  that  if 

X  >  X  (e),  we  have 
o 
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(l-&)x 

(l-€)  J  u^(x-u)®  L(u)h(x-u)du 

6x 

(l-6)x 

£  J  u^(x-u)®  L(u)h(x-u)du  . 

fix 


Thus, 


(A.IO)  (1-0  L(x)h(x)  j'  ‘  v''(l-v)=  d,  <  C2(x) 

fi 

<  (l«)x«^«L(x)h(x)  f  v'-(l-v)^  dv  . 

fi 


Now,  it  Is  a  basic  fact  of  slowly  varying  functions  that 
L(ax)/L(x)  converges  to  1  as  x-«  uniformly  in  a,  for  a  bounded 
away  from  zero.  (See  [ll]). 

Thus,  from  (A. 10)  we  obtain 

_  Cp(x)  „ 

(A. 11)  lim  \  ■  '  '  <  (1+e)  J  v^(l-v)®  dv  <  (1+€)y  , 

X-  L(x)h(x)  i 


and 
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(A.12)  r  7^'  ,  X  ^  J  u^’d-u)®  du  >  (1-e)  y- 

L(x)h(x)  J 

Simple  computations  show  that  for  some  K  >  0, 

(A.  13)  lC^(x)l  <  Kc  L(x)h(x)  x^®+^  , 

(A.U)  lC2(x)l  <  Ke  L{x)h(x)  x^®'*’^  . 

Combining  (A. 11),  (A. 12),  (A. 13)  and  (A. 14),  we  obtain 
(A. 8). 

Corollary  A.5»  If  {C^*"^ )  is  the  mth-fold  convolution 
of  {a^}  with  itself  and 

a^  ~  n"®/L(n),  0  <  a  <  1  , 

then 

(A.15)  ~  LCn)-"  rd-a^AWl-o))  • 

Proof.  If  we  choose  a(x)  =  a^,  n  <  x  <  n+1, 
b(x)  =  b^,  n  <  X  <  n+1,  we  obtain 


r 

‘f 

I 

i 

I 
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r{  1-a)^ 


L(n)"2 


-2ort-l 
n  , 


and  (a. 15)  follows  by  induction. 
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